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Abstract — This article approaches deterministic filter- 
ing via an application of the min-plus linearity of the 
corresponding dynamic programming operator. This filter 
design method yields a set-valued state estimator for 
discrete-time nonlinear systems (nonlinear dynamics and 
output functions). The energy bounds in the process and 
the measurement disturbances are modeled using a sum 
quadratic constraint. The filtering problem is recast into 
an optimal control problem in the form of a Hamilton- 
Jacobi-Bellman (HJB) equation, the solution to which is 
obtained by employing the min-plus linearity property of 
the dynamic programming operator. This approach enables 
the solution to the HJB equation and the design of the filter 
without recourse to linearization of the system dynamics/ 
output equation. 

I. Introduction 

Deterministic filtering methods have been developed 
in the literature for linear and nonlinear systems as an 
alternative to stochastic techniques. They are especially 
applicable to situations where the noise characteristics 
are not stochastic and/or whose statistics are not known 
apriori. In such cases, the noise is typically modeled 
as an unknown process satisfying some bound in an 
H2 or H°° sense, where this may be interpreted as a 
generalization of an energy bound; e.g., see [1], [2], 
[3], [4], [5], [6]. In particular, the set membership 
state estimation approach in [2] provides a deterministic 
interpretation of the Kalman filter in terms of a set- 
valued state estimate, where the solution to the estima- 
tion problem is obtained by constructing the set of all 
possible states consistent with the given measurements. 
This set membership approach has been extended to 
estimation for nonlinear systems as presented in [6], [7], 
[8], [9], [10], [11]. 

Most estimation schemes proposed for nonlinear sys- 
tems both in the stochastic and the deterministic settings, 
use some kind of approximation schemes for the state 
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dynamics which often consist of linearizing the state 
and measurement equations about a suitable operating 
point. Indeed, this is not an issue for systems with small 
nonlinearities but the effect of nonlinearity induced 
errors needs to be considered for systems with large 
nonlinearities as presented in [7]. Another approach to 
nonlinear filtering that does not consider linearization 
of the underlying nonlinear dynamics is presented in 
[12] using the max-plus machinery. There, the nonlin- 
ear filtering problem is recast into an optimal control 
problem leading to a Hamilton-Jacobi-Bellman (HJB) 
equation. We note that the approach taken in [12] bears a 
resemblance to that here in that max-plus machinery was 
employed for value function propagation. In both cases, 
the value, as a function of the state variable is semicon- 
vex, where the space of semiconvex functions is a max- 
plus linear space (or moduloid), for which a countable 
set of quadratic functions forms a basis (or spanning 
set). However, in the case of [12], the basis elements 
used in the max-plus value function expansion were 
fixed. Here, we adopt a modification of the more recently 
developed curse-of-dimensionality-free approach, where 
that approach to infinite time-horizon control is adapted 
to the time-dependent filter value function propagation. 
That approach has been demonstrated to be highly 
effective from a computational standpoint in several 
applications [13]. In particular, the quadratic functions 
used in the truncated max-plus expansion are boot- 
strapped by the algorithm. We note that, in order to 
maintain computational tractability with this approach, 
one employs a max-plus optimal projection at each time- 
step. This is optimally performed by pruning the set of 
quadratics in the representation [14]. 

In this paper, we present a set-valued state estima- 
tion approach to nonlinear filtering for systems with 
nonlinear dynamics and observations using min-plus 
methods to obtain the corresponding deterministic filter 
The constraint on the system noise is described by a 
sum quadratic constraint (SQC) [10], [11]. A set- valued 
state estimation scheme is utilized to reduce the filtering 
problem to a corresponding optimal control problem in 
terms of an HJB equation. The optimization problem 
consists of computing the minimum quadratic supply 
needed to drive the system to a given terminal state 



subject to the SQC. The computations are achieved 
by applying a min-plus scheme to the optimization 
process where the solution operator is linear in the min- 
plus algebra. Indeed, this scheme does not employ the 
linearization of the system dynamics and provides a 
less conservative solution in terms of the filter recursion 
equations. 

The rest of the paper is organized as follows: Section 
mi describes the formulation of a nonlinear system with 
the noise bounded by an SQC. Section [III] describes the 
set-valued state estimation scheme for nonlinear filter- 
ing, and recasts the nonlinear filtering problem into a 
corresponding optimal control problem. The solution to 
the optimal control problem using the min-plus linearity 
property and the corresponding filter recursion equations 
which arise therefrom are discussed in Section |IV] An 
illustrative example is presented in Section |V] and the 
paper is concluded with remarks on future research in 
Section |Vll 



are given positive-definite, symmetric matrix functions 
of time. 

In order to derive equations for a discrete-time set- 
valued state estimator, the continuous-time system in ([T]i 
- ^ needs to be discretized in reverse time. The reverse- 
time system formulation is used to formulate and solve 
the filtering problem which is recast as a subsidiary 
optimal control problem using the HJB equation. For 
further details, see [10], [11]. Such a discretization can 
be achieved by using standard techniques such as the 
Euler or higher-order Runge-Kutta methods [16]. In 
particular, applying the Euler scheme to (H) in reverse 
time yields, 

x{t) w x{t + t) - radt + T, x{t + T),u{t + r)) 

-~TDc{t + T)w{t + T),{4-) 

where r is the sampling time. Thus, (|4| leads to the 
reverse-time discrete system of the form 



II. Problem Formulation 
Consider a continuous-time system described by 

xit) ^ a^t, x{t), u{t)) + D^t) wit); (1) 

y{t) = cS,x{t))+v{t)- (2) 

where x{) <^ M" is the state, m(-) G IR™ is the known 
control input, w(-) e W and v{-) € M' are the process 
and measurement disturbance inputs respectively, and 
y{) € M' is the measured output. ac{-) and Cc{-) are 
given nonlinear functions and Dc{-) is a given matrix 
function of time. 

The noise associated with system ([TJ - (|2]i can be 
described in terms of an IQC as in [6], [15], 



ik(o)-soii^+/ {Wwmi. + w 

Jo 
Here, vectors are organized as columns. 



\ljdt<d. 



(3) 

\v\\m ■■= 



■\/|w]j\/ denotes the Euclidean (semi-) norm of a real 
vector V generated by a real positive (semi-) definite 
symmetric matrix M, with 



Mm ■■=lv,vJM, lu,vj 



M 



u^Mv. 



Unlike the semi-norm || • \\]^j, the quadratic form |-]jv/ 
is well-defined for any real symmetric matrix AI. Also, 
x{0) is the initial state value and xq is the nominal initial 
state. A finite difference {x{0) — xo) is allowed by a non- 
zero value of the constant d. If d ~ 0, then a;(0) — xq. 
Also, w{-) and v{-) represent admissible uncertainties 
and N ~ N'^ > is a given matrix, xq £ M" is a given 
state vector, d > is a given constant and Qd-), Rc{-) 



Xk= Ak{xk+i} + BkWk+i, (5) 

Uk+i = Ck{xk+i) + Vh+i, (6) 

where ^(.)(-) and C'(.)(-) represent discrete-time non- 
linear functions and i?(.) is a given time- varying matrix. 
The control variable u is a known quantity and will be 
omitted for brevity as this paper deals with only the 
filtering problem. 

Finally, the IQC in (O is discretized to obtain an 
equivalent SQC of the form 



T-l 

\xo-xo\\% + Y^ 

s=0 



(II' 



1?.) 



<d. 



(7) 



III. Set- VALUED State Estimation and the 
Optimal Control Problem 

Consider y^ = yk to be a fixed measured output 
for the system (l5]l - (|6ll with disturbances bounded by 
the SQC (111). The set valued state estimation problem 
consists of constructing the set ZT[xo,y?s\J ,d\ of all 
states XT at time step T for the system dD - (l6]l 
with initial conditions and disturbances defined by the 
quadratic constraint in (|7]i, consistent with the measure- 
ment sequence y?... 

Given an output sequence y?., it follows from the 
definition of Zt[xo, y^Aj , d], that 

XT e ZT[xo,y°.)|f,d] 

if and only if there exists a disturbance sequence W(.) 
such that Jt{xt,W(.)) < d, where the cost functional 



Jt{xt, u'(.)) is obtained from the SQC Q and is of the 
form 

Jt(x,W(.)) = -^Wxo ~ xo\\'%+ 

T-l 

^Y.^\\^k\\l, + \\vk+i\\l,J<d (8) 

k=0 

with Vk+i = Vk+i ^ Ck{xk+i)- Here, the vector xj.) is 
the solution to the system Q - (|6]l with input disturbance 
?«(.•) and terminal condition xt = x. Hence, 

ZT[xo,yl)\i,d]^ls:eW' : mi Jrii.Wf^.)) < d\ . 

(9) 
The nonlinear optimal control problem for the system in 
(|5]l - (|6ll is defined by the optimization problem 



Vt{x) = ini Jt{x,wi.)). 

tU(.) 



(10) 



Here, it is assumed that the infimum in ( fTOl i exists. If 
not, the fulfillment of the inequality J'r(a;, u;(.)) < d 
does not guarantee the reachability of the terminal state 
X under the SQC (|7]i, in which case the inequality in (|9]l 
can only be defined as an inclusion, 

ZT[xo,yl)\J,d] C |.TeM" : mi Jt{x,W(.)) < d 

Now in order to obtain the optimal state estimates 
we must solve for the value function ( fTOJ i. This is done 
by applying the dynamic programming approach from 
optimal control theory. In a discretized form, the value 
function satisfies the dynamic programming equation 

Ffe+i(x) = mm\Vk{x{k - l)\x{k) - x)) 

where Vk{x{k — l)\x{k) = x)) denotes the value 
function at time fc — 1 given a state x at time k. Using 
the notation © and (8) for the min-plus addition (min) 
and multiplication (plus) operators respectively, we may 
rewrite the above as 

Vk+iix) = [Vk{x{k - l)\x{k) = x) 

Wo 

(E)-wo'^Q^wo (E)-\\y- C(a;)||^|. 

In the following section we describe an approach to 
solving the above. 



IV. Min-Plus structure preservation and 

FILTER DESIGN 

In this section we solve the dynamic programming 
equation as follows. We express the value function 
in a particular min-plus basis (specifically the min of 
quadratic forms). Then we exploit the linearity of the 
dynamic programming operator in this space to obtain 
a recursive equation for the parameters used in this ex- 
pansion. This recursion is possible owing to the fact that 
after propagation by the dynamic programming operator, 
this min-of-quadratic-forms structure is preserved. The 
submatrices of the quadratic form, in fact, correspond 
to the solution of the Riccati equation for optimal filter 
design. 

We will omit the time subscripts for the state and 
nonlinear functions for brevity. 

From dHJ and ([TOll we have at T = 



^o{x) := -< \\x- xa\\%o + 



which can be written in the quadratic form 



(11) 



A^ 



ieio 



',0 I X 
1 



where 



^v,0 






(12) 



Li = -xlN°, 4)° = x1^N°xa + (fP and Iq = {I}- 

At T = 1, the dynamic programming recursion 
equation can be written in the form 



Wo 

+ \\\y-c{x)\\l], (13) 

where we let A and B be time-independent for simplic- 
ity. 

Substituting for Vb from (fTTT l - ( fT2l i in ( fT3] l and using 
the backward time dynamics Q we obtain, 

Vi{x) 

= ( A ^II/-.-oIIqj'.o + \\\w4l^ + \\\gy,A\l\ , 

-A (0^11/^ 



■woiln^.o + WmWh. 



9y-x\\R {, 



(14) 



where, for the sake of enhancing clarity, we use the 
notation 

fl^^ := [{A{x) + Bwof 1], 
9y,x ■.= y-C{x). 

The minimizing wq is found from the following 
expression; 



where Q^ is a matrix, some of whose terms depend on 
y. Here M := J x C for which the following holds: 

Vj e J,l e C, 3m e M such that 



\y\ 



argmm 

Wo 



If Il2 



QJ 



I^oIIq,, 



11,0 



Solving for wo and rewriting the matrix Q^ ' in terms 
of its constituent matrices from (fTZt yields 

w*o = -[Qr, + B^N^B]-^ X [B'^hf + B^N'iA{x)] 



We further have the following representations for the 
terms in ( fTSl i: 

A{xfM^A{x) := f\{x^ 1 ) QS(A/°)) I ^Y 
A/r^(x) :- A ( ^"^ 1 ) Qo(Mf )) (l). (19) 



aGiS 



(15) Thus using ^ - ^ in ^ for l/i(a;) we obtain 



which is of the form wl+wlA{x). Substituting wq = Wq 
from (fTsT l in (fT4l i we obtain 



ieio 



where /J,„„ = (A(a;) + Su;* + BwlA{x)) 1 and 
w = [wl + wlA{x)]. Collecting terms in A{x) we find 

Vi{x) 

\A{x)\\l ^ + {l'^{I + Bwi) 



■leio K 
+ wfB^Nl'il + Bw\) + w]^Qr,w\^A{x) 



L^Bwi 



+ h\y-c{x)\\% (16) 



(/ + BwlfN°{I + Bw\) + wfQr,w\. 



where h^i 

Consider the following quadratic approximations 



-{y,C{x))R^ /\{x'^ I )HQ 



c,y 
J 



J&J 



\\C{x)\\l:=/\{x^ 1)Q?( 1 ) 



(17) 



(18) 



Note the dependence of the above terms on the output 
y (however more specifically Q^'^ only depends on the 
sign of y). Adding ( [TtI i and ( fTSI l yields 



^{y,C{x))n + \\C{x)\\j, 

meM 



-.0 I X 



^i(-)- a( a 



^oiMl 



On / X 



ex° 

T 



+ A ( -^ 1 ) Qnm) [ I 



1 )Q' 



+ A (-" oe(i)[ 



(20) 



rnSAI 



where 



ij := ,^° + 2LOi3< + [wfB^N^Bwl] 


Q"^ := I 

^1 

Now, to further simplify the expression (120) . we note 
that for all i e Iq, a e 1°, a e I^, m e M, 3fc e Ii 
(where Ii := lo x l)^ x Z^ x A^) such that 

g;:'^ := gs(Aff ) + qHm^) + q^ + q°„. 

Hence ( l20l i can be written in the form 



A 

fceii 



1 )Q 



vA / X 



Thus we have a recursive relationship in the coefficients 
of the quadratic forms between two consecutive time 
steps. By propagating these terms across multiple time 
steps we may evaluate the cost function at any desired 
x (without storing the value for x at each time step). 

From the results above, after performing the mini- 
mization with respect to the set of quadratics at the 



current time step t, the value function has the form 



V,(i) 



A5(- 



1 



■.N 



keXi^ 



(21) 



To obtain a state estimate x* we minimize the above 
with respect to x, i.e., 

X* = argmin Vt(a;). (22) 

X 

A set-valued estimate is obtained as a sub-level set of 
Vt{-). Note that the minimizing x* occurs at one of the 
troughs of one of the quadratics (say Q*) which has the 
structure 

»T 



N* 
L* 



L* 



As indicated in [10], [11] the value function may also 
be associated with the real symmetric precision matrix 
lit ;^ and the state estimate x^ as follows 

Vtix) ^lix~ S;*tflltix - X*) + ^4>f (23) 

By comparing coefficients in jTH and ( l23T l it can be seen 
that 

xl ^ --[N*'^]-^ L*"^ . 

Here, the matrix 11^ = Pt corresponds to the estima- 
tion error covariance matrix in the traditional Kalman 
filter in the stochastic setting. 

Note that in order to choose the minimizing quadratic 
we obtain the minimizing point x* for each quadratic as 
follows. Given a form 

kx^ 1] ( '^" '^^0 [ T 

2 V 921 922 / 1 



the minimizing x* for this quadratic is given by 

X* = -fell +qliV^[qi2 



il\ 



The latter is true if and only if the states are free to 
take on any values. In the case where the states are 
constrained, the minimization in (l22T i must be performed 
in the permissible set of states. 

V. Illustrative Example 

In order to demonstrate the concepts introduced in 
this article, we analyze a two dimensional system with 
linear dynamics and a nonlinear output function, defined 
as follows 



m, 



d 
Jt 


■ Xlit) ' 
X2it) 


= 


'00' 
1 




■ Xi{t) ' 
_ X2{t) 


+ 


■ 1 " 





y{t) = V2sm(x2{t)) + v{t), 



.Tl(fc + 1) 
.T2(fc + 1) _ 


= 




1 
3.1 1 




xi{k) 

_ X2{k) 




+ 


■ 0.1 ■ 




AB,., 



where u'(-) and v{-) are the process disturbance and 
measurement noise respectively. After discretization the 
system dynamics is 



(24) 



where AB^ is the increment corresponding to w{-) over 
the sampling time. 

In order to apply the deterministic filtering ap- 
proach we approximate the output function C{0) := 
±-\/2sin(6') (where the sign of the function used de- 
pends on the sign of the output as described previously 
in JTtI i and [C(6')]^ as a minimum of convex functions 
as indicated in Fig. [T] |2] 




12 3 4 5 

(a) Approximating +sin(9) 




(b) Approximating — sin(0) 

Fig. 1: Approximation of ± sin(0) as a min of quadrat- 



By applying the min-plus filter design approach we 
obtain the estimation results indicated in Fig. |3] |4] 
Intuitively, the first state is more difficult to estimate - as 
can be inferred from (l24t . there is a weak dependence 
of the second state on the first (in addition to a one 
sample delay) and the noise increment in the output has 
a reasonably high variance. 



VI. Conclusion and Future Directions 




Fig. 2: Approximation of sin^ (6) as a min of quadratics. 
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Fig. 3: State filtering 
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Fig. 4: Filtered measurement 



Tiie technique described herein provides an approach 
to the design of filters for systems with nonlinear dynam- 
ics and nonlinear output. Its main contribution is in the 
utilization of the min-plus basis expansion of the value 
function coupled with the exploitation of the linearity of 
the dynamic programming operator over such a (semi)- 
field. A few of the avenues along which a study of the 
ramifications and salient features of these methods may 
be pursued are: the error analysis of the dependence of 
the accuracy on the approximation of the output and 
system dynamics by convex functions, the extension 
to systems with uncertainty, and the development of 
optimal approximation techniques for approximation of 
any desired function via a sequence of convex functions. 
In addition, these methods provide a computationally 
tractable approach for nonlinear filtering, and the ap- 
plications of this to time critical problems would also 
provide a fruitful direction of practical relevance while 
driving further insights into these classes of approaches. 

References 

[1] R. E. Mortensen. Maximum-likelihood recursive nonlinear fil- 
tering. Journal of Optimization Theory and Applications, 2:386- 
394, 1968. I0.1007/BF00925744. 

[2] D.P. Bertsekas and LB. Rhodes. Recursive state estimation for 
a set-membership description of uncertainty. IEEE Transactions 
on Automatic Control, 16(2):117- 128, April 1971. 

[3] J.S. Baras and A. Kurzhanski. NonHnear filtering: The set- 
membership (bounding) and the H°° techniques. In NOLCOS, 
July 1995. 

[4] W. H. Fleming. Deterministic nonlinear filtering. Ann. Scuola 
Norm. Sup. Pisa CI. Set, 4(25):435^54, 1997. 

[5] W. M. McEneaney. Robust hoo filtering for nonlinear systems. 
Syst. Control Lett, 33:315-325, April 1998. 

[6] M.R. James and I.R. Petersen. Nonlinear state estimation for 
uncertain systems with an integral constraint. IEEE Transactions 
on Acoustics, Speech, and Signal Processing, 46:2926-2937, 
1998. 

[7] E. Scholte and M. E. Campbell. A nonlinear set-membership 
Iter for on-line applications. Int. J. Robust Nonlinear Control, 
33:1337-1358, 2003. 

[8] B. Zhou, J. Han, and G. Liu. A UD factorization-based nonlinear 
adaptive set-membership filter for ellipsoidal estimation. Interna- 
tional Journal of Robust and Nonlinear Control, 18:1513-1531, 
2008. 

[9] F. Yang and Y. Li. Set-membership filtering for systems with 
sensor saturation. Automatica, 45(8): 1896 - 1902, 2009. 
[10] Abhijit G. Kallapur, Ian R. Petersen, and Sreenatha G. Anavatti. 
A discrete-time robust extended Kalman filter for unceitain 
systems with sum quadratic constraints. IEEE Transactions on 
Automatic Control, 54(4):850-854, April 2009. 
[II] A.G. Kallapur, I.R. Petersen, and S.G. Anavatti. A discrete-time 
robust extended Kalman filter In American Control Conference, 
pages 3819-3823, St. Louis, Missouri, USA, June 2009. 
[12] W. H. Fleming and W. M. McEneaney. A Max-Plus-Based 
Algorithm for a Hamilton-Jacobi-Bellman Equation of NonHnear 
Filtering. SIAM J. on Control and Optimization, 38(3):683-710, 
2000. 



[13] W.M. McEneaney, A. Deshpande, and S. Gaubert. Curse- [15] l.R. Petersen and A.W. Savkin. Robust Kalman Filtering for Sig- 

of-complexity attenuation in the curse-of-dimensionality-free mils and Systems with Large Uncertainties. Control Engineering. 

method for HJB PDEs. In American Control Conference, 2008, Birkhauser, 1999. 

pages 4684^690, 2008. [16] R L. Lewis, L. Xie, and D. Popa. Optimal and Robust 

[14] W.M. McEneaney. Complexity reduction, cornices and prun- Estimation: With an Introduction to Stochastic Control Theory. 

ing. In Proc. of the International Conference on Tropical and CRC Press. Taylor and Francis Group, Boca Raton, FL, USA, 

Idempotent Mathematics, GL Lih'inov and SN Sergeev (Eds.), 2nd edition, 2008. 

Contemporary Math, volume 495, pages 293-303, 2009. 



